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Abstract 

In this paper we study multivariate polynomial functions in complex variables and their cor¬ 
responding symmetric tensor representations. The focus is to find conditions under which such 
complex polynomials always take real values. We introduce the notion of symmetric conjugate 
forms and general conjugate forms, characterize the conditions for such complex polynomi¬ 
als to be real-valued, and present their corresponding tensor representations. New notions of 
eigenvalues/eigenvectors for complex tensors are introduced, extending similar properties from 
the Hermitian matrices. Moreover, we study a property of the symmetric tensors, namely the 
largest eigenvalue (in the absolute value sense) of a symmetric real tensor is equal to its largest 
singular value; the result is also known as Banach’s theorem. We show that a similar result 
holds for the complex case as well. Finally, we discuss some applications of the new notion of 
eigenvalues/eigenvectors for the complex tensors. 

Keywords: symmetric complex tensor; conjugate complex polynomial; tensor eigenvalue; ten¬ 
sor eigenvector; nonnegative polynomial. 
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1 Introduction 

In this paper we set out to study the functions in multivariate complex variables which however 
always take real values. Such functions are frequently encountered in engineering applications 
arising from signal processing [3], electrical engineering, and control theory [37]. It is interesting to 
note that such complex functions are usually not studied by conventional complex analysis, since 
they are typically not even analytic because the Cauchy-Riemann conditions will never be satisfied 
unless the function in question is trivial. There has been a surge of research attention to solve 
optimization models related to such kind of complex functions [3, 34, 35, 16, 19]. Sorber et al. [36] 
developed a MATLAB toolbox for optimization problems in complex variables, where the complex 
function in question is either pre-assumed to be always real-valued [34], or it is the modulus/norm 
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of a complex function [3, 35]. An interesting question thus arises: Can such real-valued, complex 
functions be characterized? Indeed there does exist a class of special complex functions that always 
take real values: the Hermitian quadratic form x^Ax where A is a Hermitian matrix. In this case, 
the quadratic structure plays a key role. This motivates us to search for more general complex 
polynomial functions with the same property. Interestingly, such complex polynomials can be 
completely characterized, as we will present in this paper. 

As is well-known, polynomials can be represented by tensors. The same question can be asked 
about complex tensors. In fact, there is a considerable amount of recent research attention on the 
applications of complex tensor optimization. For instance, Hilling and Sudberythe [15] formulated 
a quantum entanglement problem as a complex multilinear form optimization under the spherical 
constraint, and Zhang and Qi [41] and Ni et al. [26] discussed quantum eigenvalue problems, 
which arised from the geometric measure of entanglement of a multipartite symmetric pure state 
in the complex tensor space. Examples of complex polynomial optimization include Aittomaki 
and Koivunen [1] who formulated the problem of beam-pattern synthesis in array signal processing 
as complex quartic polynomial minimization, and Aubry et al. [3] who modeled a radar signal 
processing problem by complex polynomial optimization. Solution methods for complex polynomial 
optimization can be found in, e.g., [34, 16, 19]. As mentioned before, polynomials and tensors are 
known to be related. In particular in the real domain, homogeneous polynomials (or forms) are 
bijectively related to symmetric tensors; i.e., the components of the tensor is invariant under the 
permutation of its indices. This important class of tensors generalizes the concept of symmetric 
matrices. As the role played by symmetric matrices in matrix theory and quadratic optimization, 
symmetric tensors have a profound role to play in tensor eigenvalue problems and polynomial 
optimization. A natural question can be asked about complex tensors: What is the higher order 
complex tensor generalization of the Hermitian matrix? In this paper, we manage to identify two 
classes of symmetric complex tensors, both of which include Hermitian matrices as a special case 
when the order of the tensor is two. 

In recent years, the eigenvalue of tensor has become a topic of intensive research interest. 
Perhaps a first attempt to generalize eigenvalue decomposition of matrices can be traced back to 
2000 when De Lathauwer et al. [11] introduced the so-called higher-order eigenvalue decomposition. 
Shortly after that, Kofidis and Regalia [20] showed that blind deconvolution can be formulated as 
a nonlinear eigenproblem. A systematic study of eigenvalues of tensors was pioneered by Lim [23] 
and Qi [29] independently in 2005. Various applications of tensor eigenvalues and the connections 
to polynomial optimization problems have been proposed; cf. [30, 27, 41, 7, 26] and the references 
therein. We refer the interested readers to the survey papers [31] for more details on the spectral 
theory of tensors and various applications of tensors. Computation of tensor eigenvalues is an 
important source for polynomial optimization [13, 22]. Essentially the problem is to maximize or 
minimize a homogeneous polynomial under the spherical constraint, which can also be used to test 
the (semi)-dehniteness of a symmetric tensor. 

In this paper we are primarily interested in complex polynomials/tensors that arise in the 
context of optimization. By nature of optimization, we are interested in the complex polynomials 
that always take real values. However, it is easy to see that if no conjugate term is involved, then 
the only class of real-valued complex polynomials is the set of real constant functions 1 . Therefore, 
the conjugate terms are necessary for a complex polynomial to be real-valued. Hermitian quadratic 
forms mentioned earlier belong to this category, which is an active area of research in optimization; 
see e.g. [24, 39, 33]. In the aforementioned papers [30, 27, 7] on eigenvalues of complex tensors, the 

1 This should be differentiated from the notion of real-symmetric complex polynomial, sometimes also called real¬ 
valued complex polynomial in abstract algebra, i.e., f(x) = f(x). 
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associated complex polynomials however are not real-valued. The aim of this paper is different. 
We target for a systematic study on the nature of synmretricity for higher order complex tensors 
which will lead to the property that the associated polynomials always take real values. The 
main contribution of this paper is to give a full characterization for the real-valued conjugate 
complex polynomials and to identify two classes of symmetric complex tensors, which have already 
shown potentials in the algorithms design [3, 16, 19]. We also proposed two new types of tensor 
eigenvalues/eigenvectors for the new classes of complex tensors. 

This paper is organized as follows. We start with the preparation of various notations and 
terminologies in Section 2. In particular, two types of conjugate complex polynomials are defined 
and their symmetric tensor representations are discussed. Section 3 presents the necessary and 
sufficient condition for real-valued conjugate complex polynomials, based on which two types of 
symmetric complex tensors are defined, corresponding to the two types of real-valued conjugate 
complex polynomials. As an important result in this paper, we then present the definitions and 
properties of eigenvalues and eigenvectors for two types of symmetric complex tensors in Section 4. 
In Section 5, we discuss Banach’s theorem, which states that the largest eigenvalue (in the absolute 
value sense) of a symmetric real tensor is equal to its largest singular value, and extend it to the 
two new types of symmetric complex tensors. Some application examples are discussed in Section 6 
to show the significance in practice of the theoretical results in this paper. Finally, we conclude 
this paper by summarizing our main findings and outlining possible future work in Section 7. 

2 Preparation 

Throughout this paper we use usual lowercase letters, boldface lowercase letters, capital letters, 
and calligraphic letters to denote scalars, vectors, matrices, and tensors, respectively. For example, 
a scalar a, a vector x, a matrix Q , and a tensor F. We use subscripts to denote their components, 
e.g. Xi being the z-th entry of a vector x, Qij being the (z, j)-th entry of a matrix Q and Fijk being 
the ( i,j , k)- th entry of a third order tensor T . As usual, the held of real numbers and the held of 
complex numbers are denoted by R and C, respectively. 

For any complex number z = a + id £ C with a, b £ R, its real part and imaginary part are 
denoted by Rez := a and Imz := b, respectively. Its modulus is denoted by \z\ := = Va 2 + b 2 , 

where z := a — ib denotes the conjugate of 2 . For any vector x £ C n , we let x H := x T be the 
transpose of its conjugate, and we define it analogously for matrices. Throughout this paper we 
uniformly use the 2-norm for vectors, matrices and tensors in general, which is the usual Euclidean 
norm. For example, the norm of a vector x £ C” is defined as ||x|| := Vx n x. and the norm of a 
d-th order tensor T £ C ni x '" xnd j s defined as 


\F\\ : = 


\ 


ni 




b=l id= 1 


• T- 

*1 ■■■Id, J *l-..*d ’ 


2.1 Complex forms and their tensor representations 

A multivariate complex polynomial /(x) is a polynomial function of variable x £ C n whose coeffi¬ 
cients are complex, e.g. f(x 1 ,^ 2 ) = x\ + (1 — i)x 2 2 . A multivariate conjugate complex polynomial 
(sometimes abbreviated by conjugate polynomial in this paper) fc( x ) is a polynomial function 
of variables x,x £ C n , which is differentiated by the subscript C, standing for ‘conjugate’, e.g. 
fc(x\,x 2 ) = x\ +X2 + xjX2 + (1 — i) x 2 2 - In particular, a general n-dimensional d-th degree conju- 
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gate complex polynomial can be explicitly written as summation of monomials 


f c {x) E H 

i=0 k=0 l<ji<"-<^_s,<n 


. X 


Je-k' 


In the above notation for a monomial cii 1 ...i k ,j 1 ...j e _ k Xi 1 ... Xi k Xj 1 ... Xj t _ k , the indices of the coeffi¬ 
cient (H 1 ...i k ,j 1 ...j l _ k are always partitioned by a to separate that of conjugate variables and that 
of regular variables. In particular, the coefficient of a monomial that only has conjugate variables 
such as x^x^ will be written as . In this definition, it is obvious that complex polynomials 
are a subclass of conjugate complex polynomials. Remark that a pure complex polynomial can 
never only take real values unless it is a constant. This observation follows trivially from the basic 
theorem of algebra. 

Given a d-th order complex tensor T E C niX '" xriti , its associated multilinear form is defined as 

ni n d 

Hx\---,x d ) := ••• 

*1=1 *d=i 

where x k E C nfe for k = 1,... , d. A complex tensor T E C niX "' xnd is called symmetric if n\ = 
■■■ = rid (= n) and every component are invariant under all permutations of the indices 

{*i,... ,id}- We remark that conjugation is not involved here when speaking of symmetricity for 
complex tensors. Closely related to a symmetric tensor T E C n is a general d-th degree complex 
homogeneous polynomial function f(x) (or complex form) of variable x E C n , i.e., 


/(*) 



n n 

'y ] ■ ■ ■ y ] ^ r h...i d xi 1 ... Xi d . 

*1=1 id =1 


( 1 ) 


In fact, symmetric tensors (either in the real domain or in the complex domain) are bijectively 
related to homogeneous polynomials; see [10]. In particular, for any n-dimensional d-th degree 
complex form 


/(*) = 


E 




X i-i ... X • 


1dl 




there is a uniquely defined n-dimensional d-th order symmetric complex tensor T E C n with 


Ti 


*1 ■■■I'd 


a il...id 

|n(n...z d )r 


V 1 < i\ < ■ ■ ■ < i d < n, 


satisfying (1), where II(ii .. .id) is the set of all distinct permutations of the indices {i \,..., id}- On 
the other hand, in light of formula (1), a complex form f(x) is easily obtained from the symmetric 
multilinear form J~(x l ,..., x d ) by letting x 1 = • • • = x d = x. 


2.2 Symmetric conjugate forms and their tensor representations 

To discuss higher order conjugate complex forms and complex tensors, let us start with the well- 
established properties of Hermitian matrices. Let A E C n with A H = A, which is not symmetric 
in the usual sense because A T ^ A in general. The following conjugate quadratic form 

n n 

x n Ax = ^ ^2 AijUclXj 
i =1 j=l 
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always takes real values for any x G C n . In particular, we notice that each monomial in the above 
form is the product of one ‘conjugate’ variable xj and one usual (non-conjugate) variable Xj. 

To extend the above form to higher degrees, let us consider the following special class of conju¬ 
gate polynomials: 

Definition 2.1 A symmetric conjugate form of the variable x G C n is defined as 

fs( x ) '■= ^2 ^ a h...id,h-jd x n ■ ■ ■ x id x h ■ ■ ■ x id- (2) 

i<* *i<—<*d<ra 

Essentially, fs(x ) is the summation of all the possible 2d-th degree monomials that consist of 
d conjugate variables and d usual variables. Here the subscript ‘S” stands for ‘symmetric’. The 
following example is a special case of (2). 


Example 2.1 Given a d-th degree complex form h(x) = Yli<i 1 <-<i d <n c h---id x n ■■■ x id > the func¬ 
tion 


H x )\ 2 = X] 


. . rp . rp 

* * * ' Xj% d 


E 


. . rp . rp 

{ -ji---jd' L n ■ ■ ■ 


v l<*i<— <id<n ) 

( c h---id ' c ji-jd) x h ■ ■ ■ x id x ji ■ ■ ■ x j, 


3d 


is a 2d-th degree symmetric conjugate form. 


Notice that |/r(ai)| 2 is actually a real-valued conjugate polynomial. Later in Section 3 we shall 
show that a symmetric conjugate form fs(x) in (2) always takes real values if and only if the coeffi¬ 
cients of any pair of conjugate monomials ... Xi d Xj 1 ... Xj d and a:.,-, ... x ]d x lx ... X{ d are conjugate 
to each other, i.e., 


a h...id,ji—jd ~ a ji -jd,h— i d > V1 < h < • • ■ < irf < 71, 1 < ji < • • ■ < j,j < n. 

As any complex form uniquely defines a symmetric complex tensor and vice versa, we observe 
a class of tensors representable for symmetric conjugate forms. 

Definition 2.2 An even order tensor T G C n2d is called partial-symmetric if for every 1 < i\ < 


■■■ <id<n, 1 < i d+ 1 < • • • < i 2 d < n 


J’jl—jdJd+l—hd — ^ (jl ’ ’ ■ 3d ) £ II(H • • • id) i {jd +1 • • • J2 d) £ . . . Z2d)- (3) 

We remark that the so-called partial-symmetricity was studied earlier in algebraic geometry by 
Carlini and Chipalkatti [6], and was also studied in polynomial optimization [14] in the framework 
of mixed polynomial forms, i.e., for any fixed first d indices of the tensor, it is symmetric with 
respect to its last d indices, and vise versa. It is clear that partial-symmetricity (3) is weaker than 
the usual symmetricity for tensors. 

Let us formally define the bijection S (taking the first initial of symmetric conjugate forms) 
between symmetric conjugate forms and partial-symmetric complex tensors, as follows: 

(i) S(J r ) = fs: Given a partial-symmetric tensor T G C n with its associated multilinear form 
J-(x l ,..., x 2d ), the symmetric conjugate form is defined as 


n n 


fs{x) = J 7 ( a;,. . .,a , a;,. . .,a ) = ^ 

*1=1 *2d = l 


*d*d+l - *2d" C *l ' ' ' X id X id +1 ' ' ' X i2d m 
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(ii) S 1 (fs) = J 7 : Given a symmetric conjugate form fs (2), the components of the partial- 
symmetric tensor T £ C n are defined by 

77 _ • ••^ddd^-l"-^ 2 d / a \ 

Sn... jdjd+1 ... j2d ~ ii,/,.../,) . 11 (/,/. , ... / 2 </.) i 1 J 

for all 1 < h < ■ ■ ■ < i d < n, 1 < i d+1 < ■ ■ ■ < i 2 d < n, (ji... j d ) € n(d ...i d ) and (j d+1 ... j 2d ) € 
n(ufi • • ■ hd)- 

Example 2.2 Given a bivariate fourth degree symmetric conjugate form fs(x ) = (1 — i)xT 2 xi 2 + 
4xix 2 xix 2 + Qxix 2 x 2 2 , the corresponding partial-symmetric tensor T = S _1 (/s) € C 24 satisfies 
that Fim = 1 - i, J -1212 = 1221 = ^2112 = ^2121 = 1,^1222 = ^2122 = 3 and other entries are 

zeros. Conversely, f s (x) can be obtained from .F((fl), (fl), (^), (^)). 

According to the mappings dehned previously, the following result readily follows. 

Lemma 2.3 The bijection S is well-defined, i.e., any n-dimensional 2 d-th order partial-symmetric 
tensor T £ C” uniquely defines an n-dimensional 2 d-th degree symmetric conjugate form, and 
vice versa. 


2.3 General conjugate forms and their tensor representations 

In (2), for each monomial the numbers of conjugate variables and the usual variables are always 
equal. This restriction can be relaxed further. 

Definition 2.4 A general conjugate form of the variable x £ C n is defined as 
d 

fo{x) — a h—ik,3l—3d-k X h ' ’ ’ X ik X jl ■ ' ’ X jd-k ■ ( 5 ) 

k =0 l<ii k< n 


Essentially, fo( x ) is the summation of all the possible d-th degree monomials, allowing any 
number of conjugate variables as well as the usual variables in each monomial. Here the subscript 
‘G’ stands for ‘general’. Obviously fs(x ) is a special case of fc{ x ), and fc( x ) is a special case of 
fc{x). 

In Section 3 we shall show that a general conjugate form fc{ x ) will always take real values for 
all x if and only if the coefficients of each pair of conjugate monomials are conjugate to each other. 
To this end, below we shall explicitly treat the conjugate variables as new variables: 

(i) G(J 7 ) = fc- Given a symmetric tensor T £ C^ 2n ^ with its associated multilinear form 
T{xf ,..., x d ), the general conjugate form of a: £ C n is defined as 


/o(x)= K (*)■■■■’ 

S - 

d 



( 6 ) 


(ii) G~ 1 (/g) = d 7 : Given a general conjugate form fa of x £ C n as (5), the components of the 
symmetric tensor J 7 £ C^ 2n l are defined as follows: for any 1 < ji,..., j d < 2n, sort these jfi s in a 
nondecreasing order as 1 < jq < ■ ■ ■ < ji d < 2 n and let k = arg max 1< ^ <d { jj ( , < n}, then 


T 


3l-Jd 


a~. 

Jn 


■ji k X3i k+1 -n)..jii d -n) 

|n(ji...jd)l 


(7) 
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Example 2.3 Given a symmetric second order tensor (matrix) F 
sponding general conjugate form is 


1010 
0020 
12 0 0 
0 0 0 3 


E C 4 


the corre- 


fc{x) = (xi, X 2 , xi, x 2 )F(xi, x 2 , xi, x 2 ) T = ixi 2 + 2xixi + 4x 2 xi + 3x 2 2 . 


Conversely, F = G 1 (fc) can obtained component-wisely by (7). 

Similar to Lemma 2.3, the following is easily verified; we leave its proof to the interested readers. 


Lemma 2.5 The bijection G is well-defined, i.e., any 2n-dimensional d-th order symmetric tensor 
T E C* 2 ”) uniquely defines an n-dimensional d-th degree general conjugate form, and vice versa. 

To conclude this section we remark that a partial-symmetric tensor (representation for a sym¬ 
metric conjugate form) is less restrictive than a symmetric tensor (representation for a general 
conjugate form), while a symmetric conjugate form is a special case of a general conjugate form. 
One should note that the dimensions of these two tensor representations are actually different. 


3 Real-valued conjugate forms and their tensor representations 

In this section, we study the two types of conjugate complex forms introduced in Section 2: sym¬ 
metric conjugate forms and general conjugate forms. 


3.1 Real-valued conjugate polynomials 

Let us first focus on polynomials, and present the following general characterization of real-valued 
conjugate complex polynomials. 


Theorem 3.1 A conjugate complex polynomial function is real-valued if and only if the coefficients 
of any pair of its conjugate monomials are conjugate to each other, i.e., any two monomials auc(x) 
and bvc{x) with a and b being their coefficients satisfying uc{x ) = vc{x) must have that a = b. 


The above condition actually implies that the coefficient of any self-conjugate monomial must 
be real. Applying Theorem 3.1 to the two classes of conjugate forms that we just introduced, the 
conditions for them to always take real values can now be characterized: 

Corollary 3.2 A symmetric conjugate form 


fs(x) Y, £ 

l<ii<”-<id<n l<ji<-”<jd<n 


is real-valued if and only if 


®ii...idiji...jd — Clj 1 ...jd,ii...idi ^ 1 ^ il ^ ^ id ^ 1 5s jl jd — 

A general conjugate form 


d 

fG ( x ) = 'Y, a h-ik,ji -jd-k x h ■ ■ ■ x ik x ji • 

k =0 l<ii<—<ife<n l<?i<— <jd-k<n 


■ X jd-k 


( 8 ) 


is real-valued if and only if 

a h—ik>h—id-k = a h—3d-kM—iki — *1 — ''' ^ < n i 1 .'h — ''' — jd-k < n, 0 < k < d. 
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Let us now prove Theorem 3.1. We first show the ‘if’ part of the theorem, which is quite 
straightforward. To see this, for any pair of conjugate monomials (including self-conjugate mono¬ 
mial as a special case) of a conjugate complex polynomial: auc(x ) and buc(x ) with a, b € C being 
their coefficients, if a = b, then 


auc{x) + buc{x) = auc(x ) + auc{x) = auc(x) + auc{x) = auc(x) + buc{x), 


implying that auc(x) + buc(x) is real-valued. Since all the conjugate monomials of a conjugate 
complex polynomial can be partitioned by conjugate pairs and self-conjugate monomials, the result 
follows immediately. 

To proceed to the ‘only if’ part of the theorem, let us first consider an easier case of univariate 
conjugate polynomials. 

Lemma 3.3 A univariate conjugate complex polynomial J2e=o Sfc=o b k ,e-kX k x i ~ k = 0 for all x € C 
if and only if all its coefficients are zeros, i.e., b k /- k = 0 for all 0 < i < d and 0 < k < i. 

Proof. Let x = pe 16 with p > 0 and 9 E [0, 2ir), and the identity can be rewritten as 


£ £ 6 w-* ei( *" 2fc) * / = o. 


(9) 


e=o \k =o 


For any fixed 9, the function can be viewed as a polynomial with respect to p. Therefore the 
coefficient of the highest degree monomial p d must be zero, i.e., 

d 

£ &M-AT i(d - 2fc)0 = 0, V 0 € [0, 2vr). 

k =0 

Consequently we have for any 9 E [0, 2n), 

d d 


£ Re ( b kjd -k) cos ((d - 2 k)9) - £ Im ( b kA _ k ) sin((d - 2 k)9) = 0, 

k =0 k =0 

d d 

£ Im (6 M _ fc ) cos ((d - 2 k)9) + £ Re ( b k)d _ k ) sin((d - 2 k)9) = 0. 


k =0 k =0 

The hrst and second parts of (10) can be respectively simplified as 
d 


£ Re (£>fc,d-fc) cos ((d - 2 k)9) 


k =0 


__ I JfklL o Re (bk,d-k + b d - k ,k) cos ((d - 2 k) 9 ) d is odd 

d -2 

Efcio Re ( h,d-k + b d -k,k) cos ((d - 2 k)9) + Re ( b d/ 2 4/2 ) d is even 


and 


d L^J 

£ Im (6fc,d_ fc ) sin((d - 2 k)9) = £ Im (- b d _ k}k ) sin ((d - 2 k)9). 

k =0 k =0 

By the orthogonality of the trigonometric functions, the above further leads to 


( 10 ) 

( 11 ) 


R'® (pk,d—k “ 1 “ bd—k,k) (fik,d—k ^d—k^k) 0, V k 0,1,..., C?. 










Similarly, (11) implies 


(bk,d—k bd—k,k) {bk,d—k T bd— k,k) 0) W k 0, 1, . . . , d. 

Combining the above two sets of identities yields 

bk,d—k — 0, V k — 0,1,..., c?. 

The degree of the function in (9) (in terms of p) is then reduced by 1. The desired result follows 
obviously. □ 


Let us now extend Lemma 3.3 to general multivariate conjugate polynomials. 
Lemma 3.4 An n-dimensional d-th degree conjugate complex polynomial 
d i 


fc(x) y ] El ^ 

1=0 k =0 l<ii<-”<ifc<n l<7i<"-<^_fe<n 


Xii • • • x ik x ji • • • x je-k 0 


for all x £ C n if and only if all its coefficients are zeros, i.e., = 0 for all 0 < £ < d, 

0 < k < £, 1 < i\ < ■ ■ ■ < ik < n and 1 < j\ < ■ ■ ■ < jd-k < n. 

Proof. We shall prove the result by induction on the dimension n. The case n = 1 is already shown 
in Lemma 3.3. Suppose the claim holds for all positive integers no more than n — 1. Then for the 
dimension n, the conjugate polynomial fc( x ) can be rewritten according to the degrees of xj and 
x\ as 

d l 

fc(x) = 'Y^2,xl k xi~ k hc(x 2 ,...,x n ). 

£=0 k =0 

For any given X 2 , ■ ■ ■, x n € C, taking fc as a univariate conjugate polynomial of x\, by Lemma 3.3 
we have 

Hq(x 2 ,...,x n ) = 0, V0<£<d, 0 < k < £. 

For any given (£,k), as h^(x 2 ,... ,x n ) is a conjugate polynomial of dimension at most n — 1, by 
the induction hypothesis all the coefficients of hf k are zeros. Observing that all the coefficients of 
fc are distributed in the coefficients of h q for all (£, k), the result is proven for dimension n. □ 


With Lemma 3.4 at hand, we can finally complete the ‘only if’ part of Theorem 3.1. Suppose 
a conjugate polynomial f(x) is real-valued for all x £ C n . Clearly we have f(x) — f(x) = 0 for all 
x £ C n , i.e., 


EE E E iph...i k ,h-u k 

£=0 k =0 l<ii<-”<ifc<n l<ji<”*<j^_fc<n 




. rp . rp 

•A'lk ^31 •••'*' 


je-k 


= 0. 


By Lemma 3.4 it follows that bi 1 ...i k ,j 1 ...j e _ k — bj 1 ...j e _ k ,i 1 ...i k = 0 for all 0 < £ < d, 0 < k < l, 
1 < i\ < ■ ■ ■ < ik < n and 1 < j\ < ■ ■ ■ < jd-k < n, proving the ‘only if’ part of Theorem 3.1. 

With Theorem 3.1, in particular Corollary 3.2, we are in a position to characterize the tensor 
representations for real-valued conjugate forms. Before concluding this subsection, let us present 
an alternative representation of real-valued symmetric conjugate forms, as a consequence of Corol¬ 
lary 3.2. 
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Proposition 3.5 A symmetric conjugate form fs(x ) is real-valued if and only if 

m 

fs{x) = ^2a k \h k (x)\ 2 , 
k= 1 

where h k (x) is a complex form and a k € M for all 1 < k < m. 

Proof. The ‘if’ part is trivial. Next we prove the ‘only if’ part of the proposition. If fs(x) is real¬ 
valued, by Corollary 3.2 we have (8). Then for any 1 < i\ < ■ ■ ■ < id < n and 1 < j\ < ■ ■ ■ < jd < n, 
the sum of the conjugate pair satisfies 



■id.,.jl- 

■jd x ii ■ ■ 

rp . rp . rp . 

• ' L id Jj 3 1 * ‘ ‘ ^3d 

+ a jl- 

■■jd,h■■ 

■id x n ■ 

. . Xj d Xi t 

... Xid 


= 

■id,3 1- 

■ ■jd x h ■ ■ 

rp . rp . rp . 

■ x id x 3 1 ' ‘ ‘ x 3d 

+ 0*1. 

-id, 3 1- 

■jd x jl ■ 

■ ■ x jd x h 

■ ■ ■ x i d 


= 1 X h 

. . . X 

id a ii. 

-id,h—3d x h ■ ■ ■ 

X 3d\ 2 ~ 

- I^u 

... Xid 

I 2 - K.. 

■idh-3d x h ■ 

■ ■ X 3d 1 2 


Summing up all such pairs (taking half if it is a self-conjugate pair), the conclusion follows. □ 
Similarly we have the following result for general conjugate forms. 

Proposition 3.6 A general conjugate form fc{ x ) is real-valued if and only if 

m 

fc(x) = ^2a k \h k (x)\ 2 , 
k= 1 

where h k {x) is a complex polynomial and a k € M for all 1 < k < m. 

3.2 Conjugate partial-symmetric tensors 

As any symmetric conjugate form uniquely defines a partial-symmetric tensor (Lemma 2.3), it is 
interesting to see more structured tensor representations for real-valued symmetric conjugate forms. 

Definition 3.7 An even order tensor T € C n2d is called conjugate partial-symmetric if 

(i) J~i 1 ...i d i d+1 ...i 2 d, = F'ji-jdjd+i-hd f or a M O'l ■ • • 3d) € n(ii ... id) and (jd+i ■ ■ ■ j 2 d) S n(irf_)_i ... * 2 d)> 
and 

(ii) ~ J 7 id+1 ...i 2d i 1 ...id 

hold for all 1 < ii < ■ ■ ■ < id < n and 1 < id+i < ■ ■ ■ < i^d < n. 

We remark that when d = 1, a conjugate partial-symmetric tensor is simply a Hermitian matrix. 
For a general even degree, the square matrix flattening of a conjugate partial-symmetric tensor; 
i.e., flattening a tensor in C n to a matrix in C^ n ) by grouping the tensor’s first d modes into 
the rows of the matrix and its last d modes into the columns of the matrix, is actually a Hermitian 
matrix. The conjugate partial-symmetric tensors and the real-valued symmetric conjugate forms 
are connected as follows. 

Proposition 3.8 Any n-dimensional 2d-th order conjugate partial-symmetric tensor T € C" 2d 
uniquely defines (under S) an n-dimensional 2 d-th degree real-valued symmetric conjugate form, 
and vice versa (under S -1 j. 
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Proof. For any conjugate partial-symmetric tensor F, fs = S (F) satisfies 


n n 


fs(x) = T( x,...,X' , x,...,x) 
d d 


E" ■ E *>■■■ 

*1 = 1 *2d = l 


*d*d+l--*2d" ( '*l • ‘ ' a '*d a '*d+l ‘ ’ ‘ "^Ld 


n n 


E E *>- 

*1=1 *2d = l 


*d*d+l---*2d" C *l ' ' ' X id X id+1 ' ' ' X hd 


n n 

= E • • • E * 

*1 = 1 *2d = l 

= fsix). 


*d+l---*2d*i---*d ;E *d+i ‘ • • x hd x h ‘ ■ ■ x id 


implying that fs is real-valued. 

On the other hand, for any real-valued symmetric conjugate form fs(x) in (2), it follows from 
Corollary 3.2 that = affFJfJFJj holds for all the possible (h, ..., i d , j±,... ,j d ). By (4), 

its tensor representation F = S ~ 1 (fs) with 


_ a *l...*d,*d+l---*2d 

*l...*d*d + l-*2d - mil ...i d )\.\U(i d+1 ...i 2d )\ 


satisfies the 2nd condition in Definition 3.7, proving the conjugate partial-symmetricity of F. □ 


Below is a useful property for conjugate partial-symmetric tensors, in the same vein as Propo¬ 
sition 3.5 for the real-valued symmetric conjugate forms. 

Proposition 3.9 An even order tensor F € C" 2d is conjugate partial-symmetric if and only if 

m 

F = ® Uk, 

k =l 


where T~L k € C n is symmetric and a k € M for all 1 < k < m. 

Proof. According to Definition 3.7, it is straightforward to verify that i ot k 'H k ®'kik is conjugate 
partial-symmetric, proving the ‘if’ part of the proposition. Let us now prove the ‘only if’ part. 

By Proposition 3.8, S(.F) is a real-valued symmetric conjugate form. Further by Proposition 3.5, 
S(F) can be written as 

m 

F{x,...,x,x,...,x) = ^ a k \h k (x)\ 2 , 

S d ^ ' d ^ fc=1 

where h k (x) is a complex form and a k € R for k = 1 ,m. Let ji k € C nd be the symmetric 
complex tensor associated with the complex form h k {x) for k = 1,... ,m; i.e., 

'H k (x,...,x) = h k ( x). 
d 

We have 


\h k (x)\ 2 = h k (x)h k {x) =U k {x,...,x)U k {x,...,x) = {U k ® U k ){x ,..., x, x ,, 


,*)■ (12) 
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Thus, the symmetric conjugate form S (EfcLi a kH k <8> Hk) satisfies 

/ m \ m 

S ^ j a k 'H k ® / Hk (®,x) = ^ oi k (%k <S> Hk)(x, ...,x,x,... 


x 


\k =1 


fc=i 

m 


^2a k \h k (x) 


k =1 


= J~( a,. ..,x , x,. . .,x) , 
d d 


i.e., S (X^fcLi &kH k <8> Hk) = S(J'). As S is bijective, we have J 7 = Efcli a kH k <8> Hk- 


□ 


3.3 Conjugate super-symmetric tensors 

Similar as for real-valued symmetric conjugate forms, we have the following tensor representations 
for real-valued general conjugate forms. 

Definition 3.10 An even dimensional tensor T E C^ 2n ' )d is called conjugate super-symmetric if 
(i) T is symmetric, and 

(H) ...i d = T n -u holds f° r all l < h, ■ ■ ■, ■ ■ , 3d < 2n with \i k - j k \ = n for k = 1,... ,d. 

We remark that the conjugate super-symmetricity is actually stronger than the ordinary sym- 
metricity for complex tensors since a second condition in Definition 3.10 is required. Actually, this 
condition is to ensure that the general conjugate form 

V ---v-' 

d, 

is real-valued. This is because if \i k — j k \ = n holds for k = 1 ,d, then the monomial with 
coefficient J 7 ,;,...j d and the monomial with coefficient in the above form are actually a con¬ 

jugate pair by noticing that the position of a conjugate variable TJ and that of a usual variable Xi 
in the vector differs exactly by n for every i. Under the mapping G defined in Section 2.3, it 
is straightforward to verify the following tensor representations for real-valued general conjugate 
forms. 

Proposition 3.11 Any 2n-dimensional d-th order conjugate super-symmetric tensor T E C^ 2n ^ d 
uniquely defines (under G) an n-dimensional d-th degree real-valued general conjugate form, and 
vice versa (under G^ 1 ). 


4 Eigenvalues and eigenvectors of complex tensors 

As mentioned earlier, Lim [23] and Qi [29] independently proposed to systematically study the 
eigenvalues and eigenvectors for real tensors. Subsequently, the topic has attracted much attention 
due to the potential applications in magnetic resonance imaging, polynomial optimization theory, 
quantum physics, statistical data analysis, higher order Markov chains, and so on. After that, this 
study was also extended to complex tensors [30, 27, 7] without considering the conjugate variables. 
Zhang and Qi in [41] proposed the so-called Q-eigenvalues of complex tensors. 
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Definition 4.1 (Zhang and Qi [41]) A scalar X is called a Q-eigenvalue of a symmetric complex 
tensor PL, if there exists a vector x called Q-eigenvector, such that 


PL{*, x,... ,x) = Xx 

d— 1 

u 

X X = 1 

k A € M. 


(13) 


Throughout this paper, the notation V stands for a position left for a vector entry. In Def¬ 
inition 13, as the corresponding complex tensor does not have conjugate-type symmetricity, the 
Q-eigenvalue does not specialize to the classical eigenvalues of Hermitian matrices. In particular, 
A € M is required in the system (13). Later on, Ni et al. [26] defined the notion of unitary symmetric 
eigenvalue (US-eigenvalue) and demonstrated a relation with the geometric measure of quantum 
entanglement. 

Definition 4.2 (Ni et al. [26]) A scalar A is called a US-eigenvalue of a symmetric complex 
tensor PL, if there exists a vector x called US-eigenvector, such that 

' PL{*, X, . . . ,x) = Xx 

d—1 

< %(•, x,...,x) = Xx (14) 

< 2-1 

_ x n x = 1. 


In fact, the Q-eigenvalue and the US-eigenvalue are essentially the same. 

Proposition 4.3 (A, x) is a pair of Q-eigenvalue and Q-eigenvector if and only if (X,x) is a pair 
of US-eigenvalue and US-eigenvector. 

Proof. First, Definition 4.2 implies that a US-eigenvalue is always real. To see this, pre-multiplying 
x 7 to the first equation of (14) gives 

PL ( x,... ,x) = Xx T x = A, 

<2 

and pre-multiplying x T to the second equation of (14) yields 

PL(x,... ,x) = Xx T x = X. 

<2 

Therefore A = A and so A € R. This actually implies that the first and second equations of (14) 
are the same by applying the conjugation to the second one. Thus, (14) is equivalent to 

PL(»,x, ... ,x) = Xx 
< 2-1 

x n x = 1 
A G K. 

The claimed equivalence is obvious by comparing the above system with (13). □ 


In terms of eigenvalues, Definitions 4.1 and 4.2 are the same. Now with all the new notions in¬ 
troduced in the previous sections—in particular the bijection between conjugate partial-symmetric 
tensors and real-valued symmetric conjugate forms, and the bijection between conjugate super- 
symmetric tensors and real-valued general conjugate forms—we are able to present new definitions 
and properties of eigenvalues for complex tensors, which are naturally related to that of Hermitian 
matrices. 
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4.1 Definitions and properties of eigenvalues 


Let us first introduce two types of eigenvalues for conjugate partial-symmetric tensors and conjugate 
super-symmetric tensors. 


Definition 4.4 A E C is called a C-eigenvalue of a conjugate partial-symmetric tensor F, if there 
exists a vector x £ C n called C-eigenvector, such that 


F(», x,... , x, x ,..., x) = Xx 


d -1 

x n x = 1. 


(15) 


Definition 4.5 A £ C is called a G-eigenvalue of a conjugate super-symmetric tensor F, if there 
exists a vector x £ C n called G- eigenvector, such that 



(16) 


In fact, the two types of eigenvalues defined above are always real, although they are defined in 
the complex domain. This property generalizes the well-known property of Hermitian matrices. In 
particular, Definition 4.4 includes eigenvalues of Hermitian matrices as a special case when d = 1. 

Proposition 4.6 Every C-eigenvalue of a conjugate partial-symmetric tensor is always real; so is 
every G-eigenvalue of a conjugate super-symmetric tensor. 

Proof. Suppose (A, x) is a C-eigenvalue and C-eigenvector pair of a conjugate partial-symmetric 
tensor F. Multiplying x T on both sides of the first equation in (15), we get 

F(x,... ,x, x ,..,, x) = Xx T x = A. 
d d 

As F is conjugate partial-symmetric, the left hand side of the above equation is real-valued, and 
so is A. 

Next, suppose (A,*) is a G-eigenvalue and G-eigenvector pair of a conjugate super-symmetric 

_ 'P 

tensor F. Multiplying (*) on both sides of the first equation in (16) yields 



d 


As F is conjugate super-symmetric, the left hand side of the above equation is real-valued, and so 
is A. □ 


As a consequence of Proposition 4.6, one can similarly define the C-eigenvalue A 6 M and its 
corresponding C-eigenvector x € C n for a conjugate partial-symmetric tensor F equivalently as 
follows. 


Proposition 4.7 A £ C is a C-eigenvalue of a conjugate partial-symmetric tensor F, if and only 
if there exists a vector x £ C n , such that 


F(x,..., x, x,..., x, •) = Xx 


x n x = 1. 


d—1 


(17) 


14 







One important property of the Z-eigenvalues for real symmetric tensors is that they can be fully 
characterized by the KKT solutions of a certain optimization problem [23, 29]. At a first glance, this 
property may not hold for C-eigenvalues and G-eigenvalues since the real-valued complex functions 
are not analytic. Therefore, direct extension of the KKT condition of an optimization problem 
with such objective function may not be valid. However, this class of functions is indeed analytic 
if we treat the complex variables and their conjugates as a whole due to the so-called Wirtinger 
calculus [32] developed in the early 20th century. In the optimization context, without noticing the 
Wirtinger calculus, Brandwood [5] first proposed the notion of complex gradient. In particular, the 
gradient of a real-valued complex function can be taken as (^, J=). Interested readers are referred 
to [34] for more discussions on the Wirtinger calculus in optimization with complex variables. 

With the help of Wirtinger calculus, we are able to characterize C-eigenvalues and C-eigenvectors 
in terms of the KKT solutions. Therefore many optimization techniques can be applied to find the 
C-eigenvalues/eigenvectors for a conjugate partial-symmetric tensor. 

Proposition 4.8 x £ C n is a C-eigenvector associated with a C-eigenvalue A £ M for a conjugate 
partial-symmetric tensor F if and only if x is a KKT point of the optimization problem 

max F(x ,..., x, x ,..., x) 
d d 

with Lagrange multiplier being d\ and the corresponding objective value being A. 

Proof. By the multilinearity of F, the gradient on x of the real-valued symmetric conjugate form 
associated with F is given by 


F(x ,...,®, ®) 4-f- F(x ,... ,x, x,..., *,•) 

d d— 1 d d— 1 


= d ■ F(xxxx), 
d d— 1 


where the equality is due to the partial-symmetry of F. 

Denote p to be the Lagrange multiplier associated with the constraint x H x = 1. The KKT 
condition gives rise to the equations 




d ■ F(», *,..., x, *,..., *) 

d— 1 d 

d ■ F(x ,..., x, #, x ,..., x) 


d—l 


X H X = 1 . 


— px = 0 

— px = 0 


The conclusion follows immediately by comparing the above with (15) and (17). 
Similarly, we have the following characterization. 


□ 


Proposition 4.9 x £ C n is a G-eigenvector associated with a G-eigenvalue A £ M for a conjugate 
super-symmetric tensor F if and only if x is a KKT point of the optimization problem 


, X 

max F 

ai H a:=l V \X 


with Lagrange multiplier being dX and the corresponding objective value being A. 
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4.2 Eigenvalues of complex tensors and their relations 

Although the definitions of the C-eigenvalue, the G-eigenvalue, and the previously defined Q- 
eigenvalue and the US-eigenvalue involve different tensor spaces, they are indeed closely related. 
Our main result in this section essentially states that the Q-eigenvalue and the US-eigenvalue are 
special cases of the C-eigenvalue, and the C-eigenvalue is a special case of the G-eigenvalue. 

Theorem 4.10 Denote PL E C nd to be a complex tensor and define F = "H <S> PL E C n2d . It holds 
that 

(i) PL is symmetric if and only if F is conjugate partial-symmetric; 

(ii) If PL is symmetric, then all the C-eigenvalues of IF are nonnegative; 

(in) If PL is symmetric, then A 2 is a C-eigenvalue of F if and only if X is a Q-eigenvalue (or a 
US-eigenvalue) of PL. 


Proof, (i) This equivalence can be easily verified by the definition of conjugate partial-symmetricity 
(Definition 3.7). 

(ii) Let x E C n be a C-eigenvector associated with a C-eigenvalue A E M of F. By multiplying 
x on both sides of the first equation in (15), we obtain 


A = F(x ,..., x, x ,..., x) = (PL <g> PL)(x ,..., x, x ,..., x) = PL(x ,..., x) ■ PL(x ,..., x) 
d d d d d d 

= \n(x,...,x )\ 2 >o. 

d 


(iii) Since the Q-eigenvalue is the same as the US-eigenvalue, we only prove the former case. 
Suppose x € C” is a Q-eigenvector associated with a Q-eigenvalue A £ M of PL. By (13) we have 
x^x = 1 and PL(», x,... ,x) = Xx , and so PL(x ,..., x) = Xx^x = A. By the similar derivation in 

d 

the proof of (ii), we get 


F(», x,... , x, x ,..., x) = PL (•,*,..., x) -PL(x,...,x) 
d —1 d d —1 d 


= PL{*, x, ...,*)• A = Xx ■ X = X 2 x, 

d -1 


implying that A 2 is a C-eigenvalue of F. 

On the other hand, suppose x € C n is a C-eigenvector associated with a nonnegative C- 
eigenvalue A 2 of F. Then by (17) we have x H x = 1 and 


PL(x,... ,x) ■ PL(»,x,... ,x) = PL(x,... ,x) ■ PL(x ,..., x, •) 

d d —1 d d —1 

= F(x,... ,x,x,... ,x,») = A 2 *, (18) 

d d— 1 


where the first equality is due to the symmetricity of PL. This leads to | PL(x,... ,x)\ 2 = A 2 . Let 
PL(x, ...,») = Xe ie with some fixed 9 E [0, 2n), and further define y = xe~ 10 ^ d . We then get 

PL(y,...,y) = M( xe- ie / d ,...,xe- i0 / d ) = (e~ id / yPi^^^x) = e~' w Xe ie = X. 

d d d 
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Now we are able to verify that y is a Q-eigenvector associated with Q-eigenvalue A of T-L. Observing 
y H y = ( xe~' w ^ d ) n xe~’ ie / d = 1 , and by (18), 


we finally get 


X x = Ti(x, ...,x)■ %(•, x ,..., x) 
d d— 1 


= A e i0 H(»,ye ie ' d ,...,ye 10 / d ) 


d -1 


= \e- ie (e ie / d ) d - 1 'H(.,y,_^ 1 y), 

d -1 


%(•, y, ..., y) = \xe w / d = A ye* e / d e w / d = Ay. 
d -1 


□ 


As we saw in Section 2, by definition, a symmetric conjugate form is a special general conjugate 
form. Hence in terms of their tensor representations, a conjugate partial-symmetric tensor is a 
special case of conjugate super-symmetric tensor, although they live in different tensor spaces. To 
study the relationship between the C-eigenvalue and the G-eigenvalue, let us embed a conjugate 
partial-symmetric tensor T £ C n to the space of . The conjugate super-symmetric tensor 

Q £ C( 2n ) corresponding to T is then defined by 


/ J~ii...i 2 d/ ( d ) ) til ■ • • 32 d) € n(ii ,..., irf, id+i T n ,..., d + ri); 
\ 0, otherwise. 


(19) 


For example when d = 1, a conjugate partial-symmetric tensor is simply a Hermitian matrix 
A € C n2 . Then its embedded conjugate super-symmetric tensor is ( j 2 A Q ) ^ C^ 2n ^ 2 , and 


clearly we have 


x t Ax 


fx \ T / O A/2 

W V ^ T / 2 O 



In general it is straightforward to verify that 



d d 



( 20 ) 


Based on this, we are led to the following relationship between the C-eigenvalue and the G- 
eigenvalue. 

Theorem 4.11 IfQG C^ 2n ^ 2d is a conjugate super-symmetric tensor induced by a conjugate partial- 
symmetric tensor T £ C n according to (19), then X is a C-eigenvalue of T if and only if A/2 is 
a G-eigenvalue of Q. 

Proof. First, by taking the gradient (J=, ^) on both sides of (20), we have that 

d ~ l d 



d d—1 2d—l 
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Next, according to Definition 4.4 and Proposition 4.7, A is a C-eigenvalue of T if and only if there 
exists a vector x £ C n such that 


.£(•, x ,..., x, x ,..., x) = A* 
d— 1 d 

J 7 (*, ®,®, •) = A® 


= 1. 


d—1 


Finally, according to Definition 4.5, A/2 is a G-eigenvalue of if and only if there exists a vector 
x £ C n such that 



The conclusion follows immediately by combining the above three facts. 


□ 


5 Extending Banach’s theorem to the real-valued conjugate forms 

A classical result originally due to Banach [4] states that if C{x l ,..., x d ) is a continuous symmetric 
d-linear form, then 

sup{|£(a; 1 ,..., x d )\ | H® 1 !! < 1,... , ||£c d || < 1} = sup{|£(®,..., x)\ | ||x|| < 1}. (21) 

d 

In the space of real tensors where x £ M n and £ is a multilinear form defined by a real symmet¬ 
ric tensor £ € M ra , (21) states that the largest singular value [23] of £ is equal to the largest 
eigenvalue [29] (in the absolute value sense) of £ , i.e., 

max £(® 1 ,..., x d ) = max |£(®,..., ®)|. (22) 

(x k ) T x k =l, k=l,...,d ® t £c= 1, a?EM n ^ v y 

d 

Alternatively, (22) is essentially equivalent to the fact that the best rank-one approximation of a 
real symmetric tensor can be obtained at a symmetric rank-one tensor [8, 40]. A recent development 
on this topic for special classes of real symmetric tensors can be found in [9]. In this section, we 
shall extend Banach’s theorem to symmetric conjugate forms (the conjugate partial-symmetric 
tensors) and general conjugate forms (the conjugate super-symmetric tensors). 


5.1 Equivalence for conjugate super-symmetric tensors 

Let us start with conjugate super-symmetric tensors, which are a generalization of conjugate partial- 
symmetric tensors. A key observation leading to the equivalence (Theorem 5.2) is the following 
result. 

Lemma 5.1 For a given real tensor T £ M™ d , if F(x l ,x d ) = J 7 (x 7r ^ 1 ' ) ,... ,x n ^) for every 
x 1 , ..., x d £ M n and every permutation ir of { 1,... , d}, then T is symmetric. 

Our first result in this section extends (22) to any conjugate super-symmetric tensors in the 
complex domain. 
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Theorem 5.2 For any conjugate super-symmetric tensor Q E we have 


max 

JC H £C = 1 


max Re Q 

(x k ) H x k =l, k=l,...,d 


X 1 


X 1 


x u 


X 


(23) 


Proof. Let y k = G M 2n for k = 1,..., d. We observe that ReG((^.i ),•••>(*<*)) is also a 

multilinear form with respect to y 1 ,..., y d . As a result, we are able to find a real tensor T € Ri 2n i d 
such that _ _ 

c:)). <*> 

As Q is conjugate super-symmetric, for any y 1 ,..., y d G M 2n and any permutation ir of {1,... , d }, 
one has 




.,y d )=ReG 

= ReG 
= F{y‘ 


X 1 


X 


x u 


x u 


r (l) 


£C 7r ( 1 ) 

X n G) 

,-,y 


x Tc{d) 
X n ( d ) 


r (d)\ 


By Lemma 5.1 we have that the real tensor T is symmetric. Finally, noticing that (y k ) T y k = 
(x k ) il x k for k = 1,..., d, the conclusion follows immediately by applying (22) to T and then using 
the equality (24). □ 


5.2 Equivalence for conjugate partial-symmetric tensors 

For extending Banach’s theorem to a conjugate partial-symmetric tensor T G C n2d , one could hope 
to proceed as follows. Since it is a special case of the conjugate super-symmetric tensor, one can 
embed T into a conjugate super-symmetric tensor G G C^ 2n ) using (19). Then, by applying Theo¬ 
rem 5.2 to G and rewriting the real part of its associated multilinear form Re G ((*i ),-■-, (* 2 d)) in 
terms of J we may have an equivalent expression as (23). However, this expression is not succinct. 
Taking the case d = 2 (degree 4) for example, it is straightforward to verify from (19) that 



= jr (f(x 4 ,x 2 , 


+F(x 2 , x 3 , x 


X 

1 



3 , x 4 ) + F(x l , x 3 , x 2 , x 4 ) + F{x l , a? 4 , x 2 ,x 3 ) 
x 4 ) + F(x 2 , x 4 , x 1 , x 3 ) + F(x 3 , x 4 , x 1 , x 2 )^j 


■= /s(*\* 2 ,* 3 ,* 4 ), 


and this would lead to 


max \F(x,x,x,x)\= max f'six 1 , x 2 , x 3 , x 4 ). 

x H x=l (x k ) H x k =l, fc=l,2,3,4 

Instead, one would hope to get 

max \F(x,... ,x,x,... ,x)\ = max ReF(x 1 ,..., x d ,x d+1 ,... ,x 2d ). (25) 

cc H cc=l ^ v ^ ^ v y (x k )^x k = l,k=l,...,2d 

d d 
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However, this does not hold in general. The main reason is that 


which is easily observed since its left hand side is invariant under the permutation of (a: 1 ,..., x 2d ) 
while its right hand side is not. In particular, (25) only holds for d = 1, viz. Hermitian matrices; 
see the following proposition and Example 5.1. 


Proposition 5.3 For any Hermitian matrix Q € C nxn , it holds that 

(. L ) max z u Qz = max R ex T Qy. (R) 

z H z=l x H x=y H y=l 

Furthermore, for any optimal solution (x*,y*) of (R) with x* + y* ^ 0, (x* +y*)/\\x* +y*|| is an 
optimal solution of ( L ) as well. 


Proof. Denote v(L) and v(R) to be the optimal values of (L) and (R), respectively. Noticing that 
R ex T Qy = x T Qy Fx^Qy), by the optimality condition of (R) we have that 


' Qy* - 2A:r* = 0 
Qy* — 2\x* = 0 
Qx* — 2 yy* = 0 
Qx* — 2py* = 0 

(; X*) H X* = 1 

. ( y*) u y* = i, 


(26) 


where A and y are the Lagrangian multipliers of the constraints x^x = 1 and y H y = 1, respectively. 

Pre-multiplying the first two equations in (26) with (s*) T and (a;*) T respectively, and summing 
them up, lead to 

2Re ( x*) T Qy* = ( x*) T Qy* + ( x*) T Qy* = 2A(a;*) T x* + 2X(x*) T x* = 4A(£C*) H ** = 4A. 


Similarly, the summation of the third and fourth equations in (26) leads to 

2Re (x*) T Qy* = 4//, 


which further leads to 

v(R) = Re (x*) T Qy* = 2A = 2p. (27) 

Moreover, the summation of the first and fourth equations in (26) yields 

Q(y* + x*) - 2\{x* + y*) = 0, 


which further leads to 

(y* + x*) n Q(y* + x*) = 2A (y* + x*) n (x* + y*) = 2\\\x* + y* || 2 . (28) 

Let z* = (x* + y*)/ 1|®* + y*\\. Clearly 2 * is a feasible solution of (L). By (28) and (27) we have 

(z*) h Qz* = 2A = Re ( x*) T Qy* = v(R). 

This implies that v(L) > v(R). Notice that (R) is a relaxation of (L) and hence v(L) < v(R). 
Therefore we conclude that v(R) = v(L), and an optimal solution z* of (L) is constructed from an 
optimal solution (x*,y*) of (R). □ 
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Example 5.1 Let T € C 24 with J -1122 = ^2211 = 1 and, other entries being zeros. Clearly T is 
conjugate partial-symmetric. In this case (25) fails to hold because: 

(i) | Tfx, x, x, x)\ = \xi 2 X 2 2 + ^ 2 2 xi 2 | < 2 |a?i| 2 |x 2 | 2 < ^(|a;i| 2 + |cc 2 1 2 ) 2 = b f or an V x £ C 2 with 
x n x = 1. 

(ii) iF{x,y, z,w ) = WU 1 Z 2 W 2 + X 2 II 2 Z 1 W 1 = 1 for x = y = (1, 0) T and z = w = (0,1) 1 . 


Thus, Banach’s theorem (25) does not hold in general for conjugate partial-symmetric tensors. A 
natural question arises: Is there any reasonable condition to ensure the identity to hold? Recall from 
Proposition 3.9 that every conjugate partial-symmetric tensor can be written as YLT= 1 a kRk <8> Rk 
where Pik € C n is symmetric and a*, E R for all 1 < k < m. If further we have all aC s being 
nonnegative, then (25) is true. Before presenting this result, we first need the following type of 
Banach’s theorem for symmetric complex tensors, whose proof can be constructed almost identically 
to that of Theorem 5.2. 


d . 


Proposition 5.4 If F E C n is symmetric, then 


max Re iF(x ,..., x) = max Re Fix 1 ,..., x d ). 

£c h cc= 1 ^ v (x k ) H x k =l, k=l,...,d 

d 


(29) 


Theorem 5.5 If a conjugate partial-symmetric tensor T E C n written as Yb’k=\ a kR-k ® R-k 
satisfies that a*. > 0 for all 1 < k < m, then 

(L r ) max Fix,..., x, x,..., x) = max R eFix 1 ,... ,x 2d ) ( R') 

£e h £c= 1 ^ v x -v- y (a: fc ) H a; fe =l, fc=l,...,2d 

d d 

Proof. Let us first introduce a sandwiched optimization model: 

(M r ) h max R eF(y,... ,y,z,... ,z). 

d d 

Denote v(L'), v(M') and v(R') to be the optimal values of (L'), ( M') and (Rf), respectively. Clearly, 
(/?/) is a relaxation of (M'), and [M') is a relaxation of {L'), implying that v(L') < v(M') < v(R'). 
Next, let {x\,... ,x 2d ) be an optimal solution of ( R'). Consider the following problem: 


max Re F{y,... , y, x 
y R y =1 

d 


d -\-1 ~*2d\ 

* 5 • • • 5 **-'* /? 


whose optimal solution is denoted by y*. Noticing that F (»,...,», x d+1 ,..., x 2d ) E C d is symmet¬ 
ric, by Proposition 5.4, we have 


ReF(y*,... ,y*,x d+1 ,... ,xf) = max Re F(y ,..., y, x d+1 ,..., x 

" -v-' y H y=i 

d d 


2 d\ 


= max Re Fix 1 ,..., x d , x d+1 ,..., x 2d ) 

(x k ) ii x k =l, k=l,...,d 

>R eF(xl,...,xl d ) = v(R’). 


For the same reason, we have 


max Re F{y *,..., y* , z ,..., z) = max Re F(y*,... , y*, x d+ ,. .. , x 2 ) 

z ii z=l ^ v ^ ^ 1 v 1 (x k ) ii x k =l, k=d-\-l,... 1 2d 

d d d 


> ReiF(y *,..., y*, x d+1 ,..., x 2d ) > v(R'), 
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implying that v(M') > v(R'). 

Finally, let (y*,z*) be an optimal solution of ( M Since a k > 0 for all 0 < k < m, we have 
Re F'(y *, • • •, y*, z*,... ,z* 

d 


= Re ( V a k U k <g> 74 j (y*, ... ,y*, z*,..., z*) 

\t^i J --*- - ---' 

Xfe - 1 / d d 

m 

= ^ a fc Re my*, •..,<)■ H k (z *,..., z*)) 

*=l ' d " " d " 

m 

<y^ k \ 7 T k (y*,...,y*)\-\n k (z*,...,z*)\ 

k=1 " d ' ' d ' 

m / \ 

< T ?! »*," ■ ,»‘)| 2 + ■ ■ ■ , V )' 2 

V ' 3 ' ' 3 ' 

= oE at y nk ® n k)( y\ y* , y*, y*j + (74 ® 74 ) 4 *, • -, ** , **, ■ ■ ■, ** ) j 

k= 1 A A A A 


= 2 (n*/*> • ■ • > i/*> i/*> • • • > y*) + -H 2 ^ • • • > **>**> • • •, **) 


< max | J 7 ( y*,...,y* , y*,...,y *) , F ( z*,...,z* , z*,.„,z : 

d d d d 

Remark that the positivity of a^’s is exploited when invoking the triangle inequality in the first 
inequality above. This implies that either F(y *,..., y*, yy*) or F(z*,... , z* , z* ,..., z*) 

d d d d 

attains v(M'), proving that v(L') > v(M'). Therefore we have v(L') = v(M') = v(R'). □ 


We remark that the condition for a k s being nonnegative in F in Theorem 5.5 is actually the 
condition for the real-valued symmetric conjugate form S(F) being a sum of squares (SOS) of 
complex polynomials; see the relation between Propositions 3.5 and 3.9. In the field of polynomial 
optimization, checking whether a polynomial is SOS can be done by the feasibility of a semidefinite 
program. In fact, there is an easy sufficient condition for the condition on F in Theorem 5.5 to 
hold: the square matrix flattening of F is Hermitian positive semidefinite. Interested readers are 
referred to [17] for details. 


6 Applications 

The theoretical results developed in the previous sections are also useful in practice. In this sec¬ 
tion, we shall discuss some applications that can be formulated as real-valued complex polynomial 
optimization models. In particular, these problems can be cast as finding the largest C-eigenvalue 
of a conjugate partial-symmetric tensor or the largest G-eigenvalue of a conjugate super-symmetric 
tensor. 

One challenge of these eigenvalue optimization problems is that the variables are coupled in 
the complex polynomial objective function. However, the extended Banach’s theorem in Section 5, 
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specifically Theorems 5.2 and 5.5, guarantee that we can separate the variables without losing the 
optimality. This enables us to focus on the multilinear (block) optimization model 


max Re Q 

(aj fe ) H a: fc = l, k=l,...,d 


X 1 


X 


1 / ’ 


x u 


x u 


for a conjugate super-symmetric tensor Q, or 


max Re F{x l ,..., x 2d ) 

(x k y i x k =l, fc=l,...,2d 


for certain conjugate partial-symmetric tensor T. One great advantage of the above models is 
that the optimization over one block variable is easy when other blocks are fixed. Therefore, some 
efficient solution methods tailored for these models can be applied, such as the block coordinate 
decent method [25] and the maximum block improvement method [8]. Conversely, the extended 
Banach’s theorem in Section 5 provides an alternative way to solve the symmetric multilinear 
optimization model by resorting to some approaches tailored for symmetric tensor problems such 
as the power method [21] and the semidefinite programming method [28, 18]. In particular, as 
the search space can be restricted to symmetric solutions, the latter equivalent model significantly 
reduces the number of decision variables, which is beneficial to many practical algorithms such as 
semidefinite programs. 


6.1 Ambiguity function shaping for radar waveform 

The ambiguity function of the waveform is often used to probe the environment in radar system. 
By controlling both the Doppler and the range resolutions of the system, it can regulate the 
interference power produced by unwanted returns [3] . To be specific, suppose vq is the normalized 
target Doppler frequency and s = (si,..., s n ) T £ C n is the radar code to be optimized. There are 
no interfering scatterers and the matrix J r € M n for r € {0,1,... , n — 1} is defined as 

The ambiguity function of s for the time-lag r € {0,1,... ,n — 1} and the normalized Doppler 
frequency v € [—|, is given by 

9s{r,v) = |s H J r (s0p(u))| 2 , 

where p(v) = (1, e 121 ™,... , e 12 ( ?l - 1 ) 7rw ) T an d q denotes the Hadamard product; interested readers 
are referred to [3] for more details of the ambiguity function and radar waveform design. 

Denote by r k the time-lag of the /c-th scatterer, and let v k be the normalized Doppler frequency of 
the k- th scatterer. The latter is usually modeled as a random variable uniformly distributed around 
a mean frequency v & with some tolerance i.e., Vf. is a uniform distribution in [Dj. — • 

Consequently, the disturbance power at the output of the matched filter is given by 

n 0 

^cr fc 2 ||s|| 2 E [g s (r k ,v k - u 0 )] + cr 2 ||s|| 2 , (30) 

k =1 

where a 2 is the variance of the circular white noise, and a & 2 is the echo mean power produced 
by the k- th scatterer. To simplify the notation, all the following normalized Doppler frequencies 
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are expressed in terms of the difference with respect to t>o- We discretize the normalized Doppler 
interval [—\, |) into m bins, denoted by discrete frequencies xj = — \ + for j € { 0 , 1 ,... ,m}. 
Let 



Then the above statistical expectations can be approximated by the sample means over A*,, i.e., 

E [g s (r k ,v k )\ ~ t-^-t Y 9s{ r ki x j)i 

1 kl je A fe 

Plugging the above expression into (30), the total disturbance power at the output of the matched 
filter can be rewritten as 

n—1 m 

= YJ2 p ( r ’ k '>\ sHjr ( s&p ( x i')')\ 2 ’ 

r=0 j=1 
cr 2 

where p(r,k ) = Ylk=i ^r,r k ^-A k (j )]^y with 5 r ,r k being the Kronecker delta and 1 a*.( j) being an 
indicator function. 

To obtain phase-only modulated waveforms, an optimization model to minimize <f>(s) subject 
to constant modulus constraints was proposed in [3]: mki| s .i =1)i=lj __ n c/)(s). Another modeling 
strategy is to account for the finite energy transmitted by the radar and assume that ||s || 2 = 1 . 
However, this single constraint does not provide any kind of control on the shape of the resulting 
coded waveform. To circumvent this drawback, one practical approach is to enforce a similarity 
constraint (see [ 2 ] for more details): 

||s - s °|| 2 < 7, (31) 

where s° is a known code which shares some nice properties such as a constant modula and a 
reasonable range resolution. Moreover, since any feasible s satisfies ||s|| = 1 and 

\\a - s°|| 2 = ||s|| 2 + ||s°|| 2 - (s H s° + (s°) H s) = 1 + ||s°|| 2 - (s H s° + (s°) H s). 

Therefore, ||s — s °|| 2 < 7 is equivalent to —(s H s° + (s°) H s) < 7 — 1 — ||s°|| 2 . Typically, the 
similarity constraint (31) is not a hard constraint, it aims to restrict the searching area within 
some neighborhood of s° and the size of the neighborhood is controlled by 7 . Motivated by the 
aforementioned equivalence, a similar result can be achieved by penalizing the quantity — (s H s° + 
(s°) H s) in the objective and we arrive the following formulation 

min ((f)(8) — p(s R s° + (s°) H s) 2 ||s|| 2 ) (32) 

||s||=l 

with penalty parameter p. Notice that the objective function in (32) is a real-valued quartic 
conjugate complex form. If s* is the optimal solution and so is — s*, then we can choose one of 
them to make sure that (s*) H s° + (s°) H s* > 0. The model (32) is obviously finding the smallest C- 
eigenvalue of a conjugate partial-symmetric tensor, which can also be viewed as finding the smallest 
G-eigenvalue of a conjugate super-symmetric tensor as mentioned in Theorem 4.11. 

6.2 The best rank-one approximation of a complex tensor 

Many modern engineering problems can be cast as multilinear least squares regression given as 

min -\\z l ® ® z d - F\\ 2 , (33) 

z k GC n k,k=l,...,d2 
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where T € C nix "' xnd is a given nonzero complex tensor. For instance, in quantum entanglement 
the geometric measure of a given d-partite pure state J~ is defined by (33); see [38, 26] for details. 

In fact, (33) can be also categorized as a G-eigenvalue problem for a conjugate super-symmetric 
tensor. To see this, first it is easy to see that (33) is equivalent to 

min \\\z l ® ® z d — T\\ 2 . 

AeR, ||z fe ||=l, k=l 


When all z k, s with \\z k \\ = 1 for k = 1,..., d are fixed, the optimal A satisfies 

- 7—112 


min IIAz 1 

asm 


z d -TV = min 

asm 


2 — 2ARe ^(z 1 ,..., z d ) + A 2 
= ||^|| 2 -(R eT(z\...,z d )) 2 . 


Therefore, by multilinearity, (33) is equivalent to 

max |Re T{z x ,..., z d )\ = max Re F^z 1 ,..., z d ). 

\\z k || = 1, k=l,...,d ||;z fc ||=l, k=l,...,d 

Let us now consider a relaxation of the above model 

max Re F(z l ,..., z d ). 

T,Li\\z k \\ 2 =d 


(34) 


(35) 


A key observation is that this relaxation is actually tight. To see this, suppose (z*,..., z(f) is 
an optimal solution of (35). Trivially we have Re J^z*, z 2 ,. .., z d ) > 0 as T is nonzero and so 
||z* || / 0 for k = 1,..., d. By noticing 

/A \ V* 


n 

^fc=i 


i|2 


< 


~y 

d^ 

k =1 


i**ii 2 = i. 


we have that nu ii«i'ii < 1 and so 

„d 


Re T 


zz \ _ 


\z\ II ’ ’ \\z d \ 


= Re ■ 


>ReT(zl,zl,... ,z d ). 


nLi ii^n 

Therefore, the feasible solution (^s*/IIII, • • •, z*/||z*||) of (34) is already optimal to the relaxation 
model (35), proving the equivalence between (34) and (35). 

Finally, to formulate (35) as a G-eigenvalue optimization problem, let us denote z = ((z 1 )' 1 ’,..., (z a! ) T ) T G 
C nd and construct a symmetric complex tensor T~L G <C^ nd ' >d such that 

• - , z ) = J r (z 1 ,...,z d ). 
d 

Thus, (35) can be rewritten as 

max R eH(z,... ,z) = max i [ W.(z,... ,z) + H(z,.. .,z) 

INI d d ll z ll d 


Vcfi 

= max - 

ll*ll=i 2 


= max Q 
ll*ll=i 


x 


x 


H(x, ...,*) + T-L{x,... ,x) 

d d 

X N 

X. 


d 
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where Q G c( 2nd ' )d is a conjugate super-symmetric tensor. The multilinear least square model (33) 
is shown to be a special case of the G-eigenvalue optimization problem. 

7 Conclusion 

This paper focuses on complex polynomial functions that incorporate conjugate variables. We 
introduced two types of conjugate complex forms and their symmetric tensor representations. Nec¬ 
essary and sufficient conditions for these conjugate complex forms being real-valued are presented, 
based on which two types of symmetric complex tensors are introduced. We present new definitions 
of eigenvalues/eigenvectors, namely the C-eigenvalue and the G-eigenvalue, which generalize the 
existing concepts of eigenvalues in the literature. Extensions of Banach [4] type’s theorem on these 
complex tensors are discussed as well. To give the readers a holistic picture Table 1 summarizes 
the main contents. 


Sec. 

Subject 

Results 


2.2 

Symmetric conjugate form and 
partial-symmetric tensor 

Def. 2.1, 

Def. 2.2, Lemma 2.3 

3.2 

Real-valued symmetric conju¬ 

gate form and conjugate partial- 
symmetric tensor 

Cor. 3.2, 

Def. 3.7, Prop. 3.8 

4.1 

C-eigenvalue and C-eigenvector 

Def. 4.4, 

Prop. 4.7, Prop. 4.8 

5.2 

Banach type theorem 

Prop. 5.3, Theorem 5.5 

2.3 

General conjugate form and sym¬ 
metric tensor 

Def. 2.4, 

Lemma 2.5 

3.3 

Real-valued general conjugate form 
and conjugate super-symmetric ten- 

Cor. 3.2, 

Def. 3.10, Prop. 3.11 


sor 



4.1 

G-eigenvalue and G-eigenvector 

Def. 4.5, 

Prop. 4.9 

5.1 

Banach type theorem 

Theorem 5.2 


Table 1: Summary of the symmetric conjugate form and the general conjugate form 

An important aspect of polynomials is the theory of nonnegativity. Most existing results only 
apply for polynomials in real variables, for the reason that such polynomials are real-valued. Since 
we have the full characterization of real-valued conjugate complex polynomials introduced in this pa¬ 
per, the question about their nonnegativity naturally arises, in particular, the relationship between 
nonnegativity and SOS. In the real domain, this problem was completely solved by Hilbert [12] 
in 1888. However, relationship between nonnegative complex polynomials and SOS has not been 
established explicitly in the literature as far as we know. This would be one of the future research 
using the notion of conjugate polynomials. Moreover, the new notions of symmetric complex ten¬ 
sors and the eigenvalues/eigenvectors would hopefully attract future modelling opportunities, and 
the newly developed properties, in particular the extension of Banach’s result would be helpful in 
solution methods for complex polynomial optimization. 
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